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ABSTRACT 

The purpose of the paper is to determine whether test 
forms of the Mathematics Usage Test (AAP Hath) of the American 
College Testing Program are parallel in a multidimensional sense. The 
AAP Math is an achievement test of mathematics concepts acquired by 
high school students by the end of the:..-' third year. To determine the 
dimensionality of the multidimensional space, each test form was 
factor analyzed at content area and item levels, and the number of 
dimensions needed to define che space was determined. A 
multidimensional item response theory analysis (MIRT) determined 
where in space each item provided the most information. A sample of 
2,500 individuals for each form was taken from the equating 
administration in 1988 of five forms of the AAP Math: 29B, 29C, 29D, 
29E, and 29F. A third step was to compare the information provided by 
each form at 49 points in the space defined by item-person 
interactions. Factor analysis showed that the tests had a very 
dominant first factor and a possible weaker second factor. MIRT 
analysis showed a fairly clear distinction betv/een story-problem 
items and those only requiring manipulation, but the constructs 
measured by these item types were highly correlai-^d. The information 
comparison indicated that the test forms all had the same basic 
structure. Considering that these test forms were not constructed 
with multidimensional considerations in mind, they are very similar. 
Eleven tables and five graphs present study data. (SLD) 
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Tne Mathematics Usage Test (AAP Math) in the ACT Assessment Program (The 
American College Testing Program, 1988) is an achievement test which measures 
the mathematics concepts acquired by high school students up to the end of 
thair third year of high school. It does not measure achievement in a 
particular course, but samples from the content taught in courses usually 
offered in grades seven through eleven. As is typical of most standardized 
achievement tests, forms of AAP Math are constructed according to a set of 
content and statistical specifications with the intent that the test forms 
meet the criteria for strict parallelism. To the credit of the test 
development staff, they regularly meet that goal to a high degree in a 
classical test theory sense. However, achievement tests that are constructed 
with an emphasis on jontent specifications are likely not to be unidimensional 
and it is uncertain whether the current test construction process yields tests 
that are parallel in a multidimensional sense when that is not specifically 
stated as a requirement in the test development process. That is, do all test 
forms measure all of the dimensions in the multidimensional space defined by 
the content domain in the same way, or does one form emphasize one dimension 
while others emphasize other dimensions. 

The purpose of this paper is to determine whether a set of forms of AAP 
Math are parallel in a multidimensional sense even though that has not oeen a 
specific requirement of the test construction process. If they are, the 
current specifications are sufficient to produce strongly parallel forms. If 
they are not, more specific test specifications may be required to improve the 
parallelism of test forms, A secondary purpose of the paper is to describe a 
set of procedures that can be used to determine whether test forms are 
multidimensionally parallel. 
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Design of the Study 
In order to determine whether test forms are parallel in a 
multidimensional sense, two factors must be considered. First, the 
dimensionality of the multidimensional space must be determined. Second, the 
information provided by the test for each linear composite of abilities in the 
space, here called the information structure, must be compared across forms. 
If the dimensionality and the information structure are the same for the test 
forms, they are multidimensionally parallel. 

In order to determine the dimensionality of the space, each form of the 
test was factor analyzed at both the comment area and the item level and the 
number of dimensions needed to define the space was determined. Once the 
dimensionality of the space was determined, a multidimensional IRT (MIRT) 
analysis was performed to determine where in the space each item provided the 
most information and the linear composite of abilities best measured by the 
item. The linear composite of abilities that defined the unidimensional score 
on the test, called the reference composite (Wang, 1987), was also determined. 

Since there is some rotational indeterminacy in the MIRT solutions for 
each form, the MIRT solutions were rotated to yield the same reference 
composite as one of the forms arbitrarily selected as a base form. The 
implied assumptions are that each of the test forms is measuring the same 
dominant dimension and that this dimension is reflected in the reference 
composite. Following this rotation to a common reference composite, the 
multidimensional information functions were computed and compared across forms 
to determine whether they had the same information structure. 
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Data 

The data used in this study was obtained from the equating administration 
of five forms of AAP Math: 29B, 29C, 29D, 29E and 29F. For the purposes of 
this paper they will be referred to as forms B through F. These forms were 
produced in the 1987-88 production year and were equated in Fall, 1988. A 
sample of 2500 individuals for each form was taken from the equating sample. 
These samples were considered randomly equivalent since the forms were 
distributed in spiralled fashion. This was an operational administration of 
the forms so examinees were motivated to do well. 

The content specifications for AAP Math consist of six content areas and 
a number of test questions assigned to the content areas. Table 1 summarizes 
these content specifications. For this paDer the content areas will be 
abbreviated as follows: Arithmetic and Algebraic Operations, AAO; Arithmetic 
and Algebraic Reasoning, AAR; Geometry, G: Intermediate Algebra, lA; Number 
and numeration Concepts, MS; and Advanced Topics, AT. It was a requirement 
that all forms have the specified number of items for each content area. 



Insert Table 1 about here 



The statistical specifications for the forms place constraints on the 
distribution of p-values and biserial correlatior discrimination indices. 
The p-values for a form should have an average as close to .5 as possible and 
should range from .3 to .8 according to a specified distribution. Biserial 
correlations should be above .3 and should have an equal mean value across 
forms. When forms are constructed, content considerations take precedence, 
followed by item difficulty specifications, and then discrimination 
specifications. No attempt is made to match the difficulty or disc, iminating 
power of content areas across forms, although content areas tend to sort 
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themselves on difficulty due to the inherent complexity of the material (i.e., 
algebra is generally more difficult than arithmetic). The ACT Assessment 
Program Technical Manual (The American College Testing Program, I988) provides 
further information about the test construction process. 

Results 

To describe the parallelism of the test forms in a classical psychometric 
sense, a standard item and test analysis was performed on each test form. The 
results of this analysis are summarized in Tables 2 and 3. Given the sample 
size involved, some significant differences may exist in these form 
statistics, but in general, the forms appear very similar on the basis of 
classical statistics. They also clearly meet the statistical specifications 
set out for the test forms. Of course, the content specifications were also 
exactly met. 

Insert Tables 2 & 3 about here 

Two different facto*" analyses were performed on each test form to 
determine the appropriate number of dimensions to use for the MIRT analysis. 
The first analysis, a principal factor analysis, was performed on the Pearson 
product movement correlations between the number correct scores on each of the 
content aieas. Thus, the analysis was perfo med on a six by six correlation 
matrix, with the variables being content areas. The correlation matrices for 
all five forms are given in Table 4. 

Insert Table 4 about here 

While there is some variation in the correlations between the content 
areas, particularly when the number of items in the content area is small (AT, 



G 



2; AAO, H; MS, 4), there are also noticeable regularities. The highest 
correlation with AAR is most frequently G. AAO tends to correlate most highly 
with lA, The magnitudes of the correlations are uniformly large. 

Table 5 shows the six eigenvalues and the factor loadings on the first 
factor for each of the test forms. These results show that all of the forms 
have content areas that are dominated by one factor that accounts for 8855 or 
more of the variance and that lA loads highest on the first factors on all 
analyses. NNS and AT have the lowest loadings for all analyses. In general, 
these results would suggest that AAP Math is highly unidimensional despite the 
multiple content areas. 



Insert Table 5 about here 



The item factor analysis was performed on the matrix of interitem 
tetrachoric correlations. The principal factor method was performed using the 
largest correlation with the item as a communality estimate. The eigenvalues 
greater than one for each form from this analysis are given in Table 6. The 
eigenvalues support a latent space dominated by one factor with possibly a 
second, minor factor. These results, and the results of the content area 
factor analyses, indicate thac the da.ta from the test forms have a dominant 
first factor, but that there may be a significant second factor. Therefore, 
it was decided to perform a two dimensional MIRT analysis on the data. 



Insert Table 6 about here 



The MIRT analysis was performed using the MOHARM program (Fraser, 1983) 
specifying a two dimensional solution. This program estimates the parameters 
of the multidimensional normal ogive model given by the formula 
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P(!iij = l|a., d., Bj) = c. + (1 . c) + d.) de^ 

where <^ { ) is the normal density function. The parameters of this model can 
be converted to estimates of logistic item parameters by dividing them by 
1.7. The d-parameter estimates from this model are presented for each item in 
Table 7 and the a-parameter estimates are presented in Table 8. A c-parameter 
of ,16 was assumed for all analyses. 

Insert Tables 7 and 8 about here 

The values obtained from the NOHARM program are not directly comparable 
because of the rotational indeterminacy of the solution. In order to obtain 
comparable solutions, the reference composite for form B was arbitrary 
selected as a reference direction in the space and the solutions for the other 
four tests were orthogonally rotated so that they all had the same direction 
for their reference composites. The angles with the coordinate axes for the 
initial orientation of the reference composites are given in Table 9* 
Following the rotation, all reference composites had the orientation given by 
Form B, Note that the axes for Forms C and D were interchanged as well as 
rotated since the relationship between content and the two dimensions were 
mirror images for these two forms when compared to the other three forms. 

Insert Table 9 about here 

The rotated solution for each of the tests is given in Table 10. This 
table provides the distance from the origin (D) and angle from 
02 (<^2^ ^^^^ defines the most discriminating direction for each item. These 
statistics are described in more detail in Reckase (1985). Table 11 provides 
average value of D and for each content area. 
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Insert Tables 10 and 11 about here 

From an analysis of the results in these tables, it can be seen that the 
angles with the coordinate axes vary substantially across items. For example, 
the first AAO items on Forms C and D measure mostly while many of the AAR 
items measure mostly e, (are 90° from Q^). A review of the text of these 
items shows that the former items are mainly arithmetic computation items. 
The latter items are story problems with significant amounts of text and 
little advanced mathematics. Thus, the items seem to vary on verbal problem 
solving versus computational and symbol manipulation skills. The AAR items, 
uniformly across forms, have the highest average angular distance from Gj. 
This indicates the AAR items, in general, have the greatest requirement for 
verbal problem solving skills. The lA items are quite different than the AAR 
items with an angular difference between the two content areas of 25^ to 
30°. Such an angular difference would result in a correlation between true 
scores of about .86 suggesting why the factor analysis results implied a 
strongly unidimensional test. However, the results of the MIRT analysis imply 
that distinctly different skills are being assessed by the test even though 
the skills are highly correlated. 

The purpose of the last set of analysis was to determine whether the 
forms measured the various skills with the same precision and emphasis. To 
determine whether the test forms were multidimensionally parallel, the 
multidimensional information was determined for each form for ten different 
directions in the space (ten different linear weightings of 9, and Gj). The 
information in each of these directions is shown by the length of a line in 
that direction at each of i\9 points in the two-dimensional ability space. 
Figure 1 gives the graphic representation of the i>iformation for Forms B 



o 9 

ERIC 



9 



through F. If the forms are multidimensionally parallel, the information 
plots for these forms should all look the same. 

Insert Figure 1 about here 

A review of the information plots shows substantial similarity and also 
some notable differences. The graphs show that all of the forms are most 
informative for persons above the mean, which was arbitrarily set at (0,0). 
Forms B, D and F provide somewhat more information than the other two forms. 
These forms also have higher KR-20 values (see Table 2). Form B seems to 
provide more information for the high ability examinees than the other forms, 
but overall the forms seem very similar in the pattern of information they 
provide. 

Discussion and Conclusion 

Achievement tests are typically designed to measure a complex of skills 
related to a curriculum area. These tests are inherently multidimensional in 
what they measure. Yet, a single score is often reported to surranarize an 
examinees performance on such a test. This score may have slightly different 
meanings at different points on the score scale depending on the relationship 
between the contents and the difficulty of the items that measure it. Even 
though a set of test forms measure more than one ability, they still can be 
considered parallel if the interrelationship between the skills measured is 
the same across the forms. In fact* if the items on the test measure the same 
linear combination of skills, the test will be indistinguishable fro.Ti a 
unidimensional test. 

It was the purpose of the research reported here to investigate the 
multidimensional parallelism of five forms of the AAP Math test. Three steps 
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were followed to investigate the multidimensional parallelism. First the 
tests were factor analyzed to determine the dimensionality of the space 
defined by the interaction of the examinees with the items. This analysis 
showed that the test forms had a very dominant first factor, but that a weaker 
second factor might be present. Therefore, further analyses were performed 
assuming a two dimensional space. 

The second step was to perform a MIRT analysis on each of the five test 
forms. This analysis showed that there is a fnirlv clear distinction between 
the arithmetic items that are in story problem format and those items that 
only require computation or formula manipulation. However, the constructs 
measured by these two different types of items are highly intercorrelated. 

The third step in the investigation was to compare the information 
provided by each form at ^9 points in the space defined by the item/person 
interactions. The information comparison showed that the test forms all had 
the same basic information structure , but that there were some differences in 
the forms. Three forms seemed to provide more information than the other two 
and one of the forms seemed to provide more information for high ability 
examinees. Whether those differences are of practical consequence is 
unknown. But considering that these forms were not constructed with 
multidimensional considerations in mind, they are amazingly similar. 

As always, this research points out the need for further research. Means 
are needed to determine how much of a difference in the information structure 
i:. important and how to better represent the differences. The information 
graphs contain substantial amounts of information, but they are difficult to 
compare directly. These topics will be che focus of future work. The main 
value of this paper, however, is that it is a beginning at building a 
methodology for studying multidimensional parallelism. 
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Table 1 

Specifications for the AAP Mathematics Usage Test 



Description of the test. The Mathematics Usage Test is a 40-item. 50-minute test that measures the students' mathematirai 

SKd inc T''''''' 'T'\'' '''''''' '''' encountered m mt poToconl^ 

curricula and includes a sampling of mathematical techniques covered in high school courses The test emohasizes 
quantitative reasoning, rather than memorization of formulas, knowledge of techniques, or compuSonatsk, Lch item m 
the test poses a question with five alternative answers. "'"fjuiduonai skiii. tacn item in 

Content of the test. In general, the mathematical skills required for the test involve p.ofic.encies emphasized in hiah school 
plane geometry and first- and second-year algebra. Six types of content are included m the test. These Segories a^^^^^ 
approximate proponion of the test devoted to each are given below. categories and the 

Mathematics Content Area Proportion of Test Number of Items . 

a. Arithmetic and Algebraic Operations .10 ' 4 



b 



c. 



b. Arithmetic and Algebraic Reasoning .35 

c. Geometry 20 

d. Intermediate Algebra 20 

e. Number and Numeration Concepts .iq 4 

f. Advanced Topics 05 



14 
8 
8 



2 



Total 1.00 40 



stu^eT^hfn'lpS^^^^^^ Operaf/ons. The items in this category explicitly descnbe operations to be performed by the 
nllr manipulating and simplifying expressions containing arithmetic or algebraic fractions 

Sl!!!l!c rlt.11?nl^!^^^^^ ^''l? ^"''^ P'"^'^"^' P^^^^"* P^^^*"^^' which algebraic and/or 

Sv^'on7;hl^?,!!r' *^'f,'^^*^9°^y ^over such topics as measurement of lines and plane surfaces, properties of 
polygons, the Pythagorean theorem, and relationships involving circles. Both formal and applied probtems are included. 

iTecTct'^ul!.^^^^^^^^ '"'^^ dependence and vanation of quantities related by 

Sons and q^^ ^-'taneous equations, inequalities, exponents, radicais. graphs of 

^TelZi'^nnS!^^^^^^ '^^^ *°P'" ^a<'°"a' ^nd .rrational numbers, set 

rnZ"n!? ^"^'"^ I;-: s^'^h topics as tngonometric functions, permutations and 

combinations, probability, statistics, and logic Only simple applications of the skills implied by these topics are tested 
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Table 2 

Summary of Test Form Characteristics 



Statistic 



Form 



B 18.8 8.7 .17 .13 .53 .10 .90 

C 19.4 8.4 .Il9 .15 .56 .09 .89 

D 19.3 8.7 .18 .15 .59 .11 .90 

E 19.2 8.2 .US .16 .56 .12 .89 

F 20.5 8.9 .51 .11 .59 .10 .91 



Note: Sample size is 2500 for eac. .orm. 
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Table 3 
Item Statistic Distribution 
for Each Form 



p-va3 ues 
. Range 



of Values 


B 


C 


D 


E 


F 


of Values 


B 


C 


D 


E 


F 


.00 - .19 


0 


0 


0 


1 


0 


.00 - .19 


0 


0 


0 


0 


0 


.20 - .39 


13 


14 


14 


13 


9 


.20 - .29 


0 


0 


0 


1 


0 


.40 - .59 


18 


16 


16 


13 


17 


.30 - .39 


1 


2 


3 


3 


1 


.60 - .79 


8 


10 


10 


13 


13 


.40 - .49 


6 


7 


5 


5 


7 


.80 - 1.00 


' 1 


0 


0 


0 


1 


.50 - 1.00 


33 


31 


32 


31 


32 
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Table 4 

Correlations Between Content Areas 
for AAP Math Forms B Through F 



Content Area 



Content 



Area 


Form 


G NMS 


lA 


AAR 


AT 


AAO 


B 


.58 .49 


.60 


.61 


.48 




C 


.54 .48 


.65 


.58 


.34 




D 


.57 -.46 


.63 


.59 


.38 




E 


.57 .54 


.61 


.59 


.35 




r 




fin 


O 1 


• 4 1 


G 


B 


.49 


.63 


.66 


.48 




C 


.49 


.61 


.61 


.37 




D 


.50 


.67 


.66 


.46 




E 


.54 


.63 


.61 


.40 




c 
r 


c: 1 
• 0 1 




.0 / 


• 40 


NNS 


B 




.56 


.51 


.41 




C 




.53 


.48 


.29 




D 




.55 


.52 


.34 




E 




.57 


.55 


.34 




F 




.53 


.49 


.38 


lA 


B 






.60 


.50 




C 






.63 


.38 




D 






.65 


.46 




E 






.60 


.39 




F 






.62 


.48 


AAR 


B 








.50 




C 








.43 




D 








.43 




E 








.38 




F 








.46 
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Table 5 

Eigenvalues and First Factor Loadings 
for the AAP Math Forms 



Form 

Eigenvalue 



Number 


B 


C 


D 


E 




1 
1 


3.71 


3.51 


3.65 


3.59 


3.69 


2 


.60 


.76 


.69 


.74 


• 04 


3 




.56 


.56 


.48 




4 


43 


.47 


.44 


.43 


illl 


5 




.38 


.35 


.40 


• io 


6 


.33 


.33 


.31 


.35 




Content 












Area 




First Factor Loadings 




AAO 


.75 


.74 


.72 


.74 


.72 


G 


.11 


.74 


.79 


.76 


.82 


NNS 


.65 


.63 


.64 


.70 


.64 


lA 


.79 


.81 


.82 


.79 


.81 


AAR 


.79 


.78 


.79 


.76 


.77 


AT 


.62 


.49 


.54 


.49 


.58 
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Table 6 

Eigenvalues Greater than One 
for the Principle Factor Analysis 
of the Interitem Tetrachoric Correlations 



Form 

B C D E F 

16.95 15.53 17.14 15.86 16.87 
Eigenvalues i.60 1.66 1.47 1.68 1.31 

1.05 1.12 1.18 

1.01 
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AAO 

AAO 

AAO 

AAO 

G 

G 

G 

G 

G 

G 

G 

G 

NNS 

NNS 

WNS 

NNS 

lA 

lA 

lA 

lA 

lA 

lA 

lA 

lA 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AAR 

AT 

AT 



Table 7 
d-parameter Estimates 
for the Five AAP Math Forms 



"orm 



Item Content B 





.yo 


1 . 17 


.47 


.50 


— ♦ID 


r\r\ 


-. 12 


.31 


1 .00 


oil 


19 


. 10 


.31 


.19 




1 on 
-1 .iO 


-1.11 


-1 .45 


-.41 


. ou 




-.05 


-.29 


.22 


OH 


1 C 

-•lb 


-•d5 


.54 


-.58 




- >D0 


-7.44 


.08 


-.62 


- . / U 




-3.50 


-2.39 


-.78 


1 ii 1 n 


-•04 


-.77 


-1 .04 


-.45 


- 1 . DO 


1 Qn 

- 1 .oO 


-.93 


- 96 


-1.95 


Q 7 1 


1 111 

-1 • 14 


-1 .30 


-1 .60 


-1 .66 




-O . Db 


-2.3o 


-1 .74 


-2.37 


OD 


.02 


li n 

.42 


.59 


.76 




ob 


. lb 


. 15 


li li 

.44 




Jrn 

-.49 




-.50 


-.14 


- . 04 


1 CJl 

- 1 .b4 


n li 

-.94 


1 ll r" 

-1 .45 


-1 .43 


1 0 


7 1 

.71 


1 1 
1.01 


.30 


. 13 




no 
.Oi 


. 22 


.29 


.08 




0 1 

.il 


1 1 
. 1 1 


.04 


4 ll 

. 14 


— c . 1 0 


O 1 


.Ob 


-.32 


-.27 




- . 20 


Jl o 

- 43 


-.90 


-.53 


-7 Rl 


-.bi 


1 1 o 

-1.12 


-.9o 


1 oil 
-1 .34 


-1 17 


- . /4 


Jl in 
-4.10 


-.9d 


-2 .28 


-.93 


-1.27 


-1.26 


-15.08 


-1.26 


.57 


.59 


.85 


.80 


1.01 


-.20 


.46 


.76 


.77 


.23 


.36 


.21 


.30 


.11 


.2'. 


-.28 


.14 


.02 


-.09 


-.06 


-.22 


.06 


-. 10 


-.04 


.14 


.14 


-.56 


.03 


.23 


-.25 


-.45 


-.28 


-.38 


-.25 


-.68 


-.36 


-.45 


.41 


-.53 


-.09 


-1.02 


-.94 


-1.06 


-.94 


-.31 


-.84 


-1.26 


-.66 


-1.27 


-.54 


-.62 


-.93 


-1.49 


-1.57 


-1.10 


-1.10 


-1.71 


-1.28 


-1.40 


-4.48 


-1.50 


-1.49 


-2.30 


-5.56 


-1.36 


-4.93 


-i.6q 


-2.89 


-2.41 


-1.69 


.13 


-.15 


-.78 


-.12 


.36 


-.90 


.14 


-1.30 


-.69 


-.95 
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Table 8 
a-parameter Estimates 
for the Five AAP Math Forms 



Form 



n Content 


B 


c 




D 




E 




F 








1 


a^ 


''I 


a^ 




a^ 


1 


a^ 
2 


AAO 


1 .02 


0.00 


.91 


0.00 


1.44 


.00 


1 .08 


0.00 


1 .43 


.00" 


AAO 


1 .34 


.37 


1.84 


.76 


1 .08 


.76 


.80 


.69 


.60 


1 .28 


AAO 


1 .01 


.30 


.70 


.91 


.84 


.26 


1 .21 


.62 


.74 


.96 


AAO 


2.67 


1.58 


1 .35 


.70 


1 .29 


1 73 


1.36 


1 .05 


1.11 


.67 


G 


.40 


-.13 


.87 


.64 


.51 


.41 


.86 


.23 


.80 


.59 


G 


1.24 


.20 


.71 


1 .28 


2. 14 


1 .35 


.38 


.35 


1 .02 


1 .31 


G 


1.25 


.37 


.92 


.44 


5.55 


4.23 


1.11 


1.11 


.63 


.61 


G 


.76 


.20 


2.54 


2.20 


2.38 


2.79 


4.00 


2.35 


.73 


.54 


G 


10.51 


3.98 


.32 


.28 


.83 


.84 


1 . 10 


.26 


.76 


.54 


G 


1 .48 


.42 


.81 


.42 


.30 


.51 


.61 


.25 


1.68 


1 .67 


G 


8.42 


1.95 


.86 


.44 


1.03 


.91 


1.29 


.14 


2. 14 


2.52 


G 


6.06 


3.26 


3.53 


3.48 


2.22 


1.43 


1.24 


. 17 


2.64 


2.76 


ms 


.84 


.22 


.56 


.27 


.72 


.41 


1 .05 


.62 


.56 


.80 


NNS 


.47 


.19 


.67 


.42 


.66 


.49 


.97 


.76 


.57 


.55 


NNS 


.87 


.60 


.60 


.52 


.26 


.29 


.99 


.44 


.50 


.55 


MNS 


.79 


.49 


.84 


.49 


.91 


.66 


.67 


.11 


.73 


.72 


lA 


.94 


.72 


.90 


.30 


1.68 


.44 


.71 


.65 


.56 


.82 


lA 


.94 


.61 


.60 


1 . 18 


1.11 


.42 


.62 


.86 


.78 


1 .26 


lA 


.61 


.37 


.80 


.36 


.85 


.40 


2.06 


1.84 


.42 


.48 


lA 


3.00 


2.36 


1.46 


.55 


1 .21 


.50 


.96 


1 .08 


1 . 12 


1.11 


lA 


1 .07 


.74 


1 .22 


.74 


1.13 


.62 


1 .03 


.98 


.70 


1.14 


lA 


7.51 


4.02 


1 . 16 


.63 


1 .37 


.96 


1.12 


.84 


1 .43 


1 .53 


lA 


1 .05 


.60 


1 . 12 


.48 


4.07 


2.68 


.86 


.57 


2.01 


1 .81 


lA 


.83 


.57 


.98 


.54 


1.01 


.90 


6.34 


2.25 


.54 


.47 


AAR 


.81 


-.31 


.34 


.78 


.49 


.65 


.53 


.49 


.46 


.46 


AAR 


.48 


.11 


.41 


.40 


.83 


.53 


.86 


.22 


.81 


.23 


AAR 


.94 


-.27 


.37 


.80 


.54 


.53 


1.15 


.10 


.72 


.32 


AAR 


.67 


.09 


.49 


.69 


.70 


1.15 


.39 


.26 


.71 


.15 


AAR 


.96 


-.24 


.46 


.52 


.64 


.73 


.62 


.32 


.45 


.25 


AAR 


1.55 


.11 


.63 


1.52 


.52 


.56 


.65 


.17 


.80 


.35 


AAR 


.69 


.24 


.37 


.63 


.79 


1 .40 


1.35 


-.05 


1.42 


.37 


AAR 


.66 


-.19 


1.07 


.92 


.61 


1.19 


.37 


.07 


.50 


.30 


AAR 


.85 


.25 


.52 


.98 


.21 


.77 


.46 


-.10 


.45 


.23 


AAR 


.76 


-.01 


.44 


1.77 


.33 


.58 


1.30 


.02 


1.37 


.39 


AAR 


.89 


-.00 


.42 


.78 


.44 


1.09 


1.18 


.43 


1.30 


.49 


AAR 


1 .56 


.19 


.53 


.93 


.50 


.66 


1.25 


.01 


4.24 


2.96 


AAR 


1.16 


.92 


1.13 


.74 


1.39 


1.60 


4.88 


.80 


1.21 


.45 


AAR 


3.76 


-.10 


.56 


.91 


.76 


1.91 


1.46 


-.34 


1.25 


.68 


AT 


.88 


-.01 


.31 


.54 


1.40 


.65 


.66 


.42 


.46 


.25 


AT 


1.39 


.87 


.41 


.67 


.39 


.81 


.64 


.10 


1.19 


1.29 
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Table 9 

Angle of the Reference Composite 
with each Axis for each AAP Math Form 



Axis 






Form 








B 


C 


D 


E 


F 




31 


47 


19 


21 


11 




59 


13 


11 


66 


19 



21 



21 



Table 10 

Distance and Direction for the Icems 
on Each Test Form ax^ter Rotation 
to the Form B Reference Composite 



Form 



Item B 
Content D a 



2 E ^2 £ ^2 R ^2 E ^2 



AAO 


O If 

-.34 


90 


-.99 


16 


-.81 


18 


-.44 


83 


-.35 


99 


A fin 

AAO 


. 12 


75 


-.00 


39 


.10 


53 


-.29 


42 


-.71 


35 


A AA 

AAO 


.22 


73 


.16 


69 


-.11 


35 


-.23 


56 


-.16 


47 


A AA 

AAO 


Q 1 

.o1 


60 


Or- 

.85 


44 


.51 


71 


.84 


45 


.32 


69 


(j 


-1 .91 


108 


.26 


52 


.08 


57 


.32 


68 


-.22 


53 


r» 
U 


.43 


81 


. 1 1 


77 


.26 


50 


-1 .04 


40 


.35 


47 


rt 
U 


.33 


74 


.59 


42 


1 .20 


61 


-.05 


38 


.68 


57 


rt 
U 


oo 
.00 


75 


.78 


57 


.96 


67 


.52 


52 


.86 


63 


b 


2.35 


48 


1 .50 


58 


.65 


63 


.92 


69 


.48 


64 


b 


1 .Oo 


74 


1 .96 


44 


1 .53 


77 


1 .45 


61 


.82 


55 


U 


1 nO 

1 .9o 


67 


1 .18 


43 


.94 


59 


1.23 


76 


.50 


50 


rt 
U 


1.16 


li 

54 


1 .74 


61 


.90 


51 


1.39 


75 


.62 


53 


NNo 


-.42 


75 


-.03 


42 


-.51 


47 


-.49 


52 


-.78 


44 


MMQ 

NNo 


.57 


67 


-.46 


li r\ 

49 


-.19 


54 


-. 12 


45 


-.55 


56 


MMC 

NWo 


.55 


55 


.62 


57 


1.53 


65 


.55 


59 


.20 


52 


MMC 

NNo 


.09 


5o 


1 .58 


46 


.83 


54 


2.14 


73 


1 .40 


55 


T A 

lA 


1 A 

- . 10 


52 


-.75 


34 


-.58 


33 


-.31 


40 


■•.13 


43 


T A 


OA 

-.30 


57 


-.03 


79 


-.19 


39 


-.27 


29 


-.06 


41 


T A 


.35 


f" A 

59 


-.35 


li r\ 

40 


-.12 


43 


-.01 


41 


-.22 


50 


lA 
X n 






OA 


i 1 


Ail 

- .04 


ll 1 

41 


.22 


nil 

34 


.17 


55 


lA 


.38 


55 


.14 


48 




47 


.64 


39 


.40 


41 


lA 


1 .29 


48 


.48 


45 


.67 


53 


.70 


46 


.64 


52 


lA 


.97 


60 


.61 


40 


.84 


51 


.93 


49 


.84 


57 


lA 


.93 


56 


1.14 


45 


.93 


59 


3.00 


56 


1.75 


58 


AAR 


-.56 


111 


-.70 


83 


-1 04 


71 


-1.11 


40 


-1.56 


55 


AAR 


.41 


77 


-.80 


61 


-.77 


50 


-.87 


68 


-.27 


83 


AAR 


-.36 


105 


-.24 


81 


-.40 


62 


-.10 


78 


-.27 


75 


AAR 


.41 


82 


-.17 


71 


-.01 


76 


.19 


49 


.08 


87 


AAR 


.22 


104 


-.09 


65 


.11 


66 


.06 


56 


-.28 


70 


AAR 


-.09 


86 


.34 


84 


-.04 


65 


-.34 


68 


.29 


76 


AAR 


.62 


71 


.38 


76 


.24 


78 


.18 


85 


.47 


85 


AAR 


.53 


* />/• 
lUU 


.32 


57 


.31 


81 


1 ."3 


72 


.16 


69 


AAR 


1.16 


74 


.84 


78 


1.3'-. 


93 


2.01 


95 


.62 


72 


AAR 


1.10 


91 


.69 


92 


.99 


79 


.98 


82 


.38 


84 


AAR 


.70 


90 


1 .05 


78 


1.28 


86 


1.26 


63 


.79 


79 


AAR 


.70 


83 


1.60 


76 


1.55 


71 


1.12 


82 


.87 


64 


AAR 


1 .01 


52 


1.10 


50 


1.08 


67 


1.12 


73 


1.05 


79 


AAR 


1.31 


92 


1.59 


75 


1.41 


86 


1 .60 


96 


1.18 


71 


AT 


-.15 


90 


.24 


76 


.50 


43 


.16 


50 


-.69 


71 


AT 


.55 


58 


-.17 


75 


1.45 


82 


1 .06 


73 


.54 


52 
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Table 11 

Summar7 of Rotated MIRT Parameters 
by Form and Content Area 



Form 



Item 




n 


r 




n 
u 




ri 




F 




Content 


D 




D 




D 




D 


"2 


D 




AAO 


.20 


74 


.00 


42 


-.08 


44 


-.03 


56 


-.22 


63 


G (8) 


.79 


73 


1.02 


54 


.82 


61 


.59 


60 


.51 


55 


NNS (4) 


.35 


64 


.43 


48 


.42 


55 


.52 


57 


.07 


52 


lA (8) 


.51 


55 


.18 


46 


.23 


46 


.61 


42 


.42 


50 


AAR (14) 


.50 


87 


.42 


73 


.43 


74 


.54 


72 


.25 


75 


AT (2) 


.20 


74 


.04 


76 


.98 


62 


.61 


62 


-.08 


62 



* Number of items 
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ERIC 
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Figure Caption 

Figure 1. Information plots for the AAP Mathematics Forms 29B - 29F. 
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